Multilayer Selection-Fusion Model for Pattern Classification

Individual classification models are recently challenged by the combined pattern recognition systems, which often show better performance. In such systems the optimal set of classifiers is first selected and then combined by a specific combination method. Large and rough search space formed from performances of various combinations of classifiers makes the selection process very difficult and often leads to selection overfitting, negatively affecting generalisation ability of the system. In this work a novel design of multiple classifier system is proposed, which recurrently uses multiple selection and fusion processes applied at many layers to a population of best combinations of classifiers rather than the individual best. On the particular implementation with evolutionary searching algorithms and majority voting, the improvement of the system’s generalisation performance is demonstrated experimentally and explained theoretically.